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1.  Introduction 

Let  X{t )  with  t  ^  0  be  a  (Borel)  measurable  stationary  Markov  process  whose 
state  space  is  a  metric  space  8  and  whose  transition  probability  function  is 

(1)  P(t;  x,  E )  =  P{X(t  +  s)E  E\X(s )  =  z}. 

Darling  and  Kac  [3]  studied  the  limiting  distribution  of  the  random  variables 

(2)  Z(t)  =  f'  F[X(r)]  dr 

as  t  — » oo,  where  V  is  a  nonnegative  measurable  function.  If  V  is  the  character¬ 
istic  function  of  a  set  E  then  Z(t)  is  the  occupation  time  of  E. 

Darling  and  Kac  assume  that 

(3)  /0"  x,  E)  dt  =  *(E)h(S)  +  />,(«;  x,  E), 

where  h(s)  — >  <»  as  s  — >  0-f  and 

(4)  hm  f  hi(s-,x,dy)V(y)  =  0, 

the  convergence  in  (4)  being  uniform  on  the  set  {x;  F(:r)  >  0}.  They  then  show 
that  the  kth  moment  yic(t)  of  Z(t )  satisfies 

(5)  s  Jo  e~gly k(t)  dt  ~  kl[ir(E)h(s)]k ,  s  — >0-f-. 

Under  the  additional  hypothesis 

(6)  h(s)  =  s-L  (i), 

where  0  ^  a  <  1  and  L(l/s)  is  slowly  varying  (see  below)  as  s  — »0-f,  they 
deduce  from  Karamata’s  Tauberian  theorem  that 

(7)  ,‘™P{ir(SlA)=“}  =  G“(M)’ 

where  Ga  denotes  the  Mittag-Leffler  distribution, 
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(8)  Ga(u )  =  —  f  Y  ^  —  T(an  -f  1  )yn~1  sin  mra  dy 

7ra  JQ  „  =  i  n! 

whose  kth.  moment  is  A:!/r(o;A:  +  1).  For  a  =  0  this  becomes  Go(u )  = 

1  —  exp  (— w)  while  for  a  =  1/2  we  have  Gmiu)  —  v~112  exp  (  —  y2/4)  dy. 

Darling  and  Kac  also  establish  a  remarkable  converse  theorem.  They  show 
that  if  (3)  and  (4)  are  satisfied  and  if  for  some  normalizing  function  v(t)  >0 

(9)  «}  =  (?(«), 

where  G  is  a  nondegenerate  distribution,  then  h(s)  satisfies  (6)  and  hence 
G{x)  —  Ga(cx )  for  some  constant  c. 

Only  in  a  few  exceptional  situations  are  sufficient  conditions  on  the  process 
known  which  insure  the  hypotheses  (3),  (4),  and  (6).  Darling  and  Kac  discuss 
as  examples  the  Wiener  process  and  a  class  of  discrete  time  processes  which  are 
sums  of  identically  distributed  independent  random  variables. 

Our  primary  purpose  here  is  to  discuss  the  validity  of  (3),  (4),  and  (6)  for 
birth  and  death  processes  (described  below).  Of  course  these  hypotheses  do  not 
hold  for  arbitrary  birth  and  death  processes,  and  what  is  required  is  to  find 
natural  assumptions  concerning  the  given  data  of  a  birth  and  death  process  from 
which  one  can  deduce  the  hypotheses.  Now  in  problems  involving  birth  and 
death  processes  the  data  one  is  ordinarily  given  consists  of  the  birth  and  death 
rates  X„,  m„.  We  present  a  theory  in  which  the  hypotheses  (3),  (4),  and  (6)  are 
derived  from  knowledge  of  the  asymptotic  behavior  of  the  birth  and  death  rates 
X„,  yn  as  n  — »  oo .  Both  the  methods  and  the  results  can  be  extended  to  general 
diffusion  processes  and  random  walks. 

In  section  3  this  result  is  extended  to  more  complicated  cases  involving  slowly 
varying  functions. 

Since  the  appearance  of  the  work  of  Darling  and  Kac,  it  has  been  found  that 
once  the  hypotheses  (3),  (4),  and  (6)  are  known  it  is  possible  to  deduce  limit 
laws  not  only  for  the  occupation  times  Z(t )  but  also  for  numerous  other  random 
variables  associated  with  the  process.  Notable  contributions  along  these  lines 
have  been  made  by  Dynkin  [4],  Lamperti  [11],  [12],  and  Takacs  [14]  (see  the 
bibliography  in  [14]).  Some  of  the  results  of  these  authors  are  discussed  below 
and  applications  are  made  to  birth  and  death  processes. 

We  also  show  that  for  birth  and  death  processes  related  assumptions  lead  to 
limit  laws  for  the  important  maximum  random  variables 

(10)  M(t)  =  max  X(r). 

Ogrgt 

This  result  is  both  interesting  in  connection  with  various  applications  and  also 
in  that  it  serves  to  indicate  the  broader  significance  of  our  main  problem. 

We  now  describe  the  main  problem  in  greater  detail.  A  birth  and  death  process 
is  a  stationary  Markov  process  whose  state  space  S  is  the  nonnegative  integers 
and  whose  transition  probability  matrix 
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(11)  PM  =  P  {X(t  +  s)  =j\X(s)  =i} 

satisfies  the  conditions,  as  t  — >  0, 


(12) 


PM 


fXt<  -+-  o(t) 


if  j  =  i  +  1, 


i  mt  +  o(t)  if  j  =  i  -  1, 

ll  -  (Xt  +  m)t  +  o(t)  if  j  =  i, 


where  X»  >  0  for  i  ^  0,  m  >  0  for  i  ^  1,  and  juo  ^  0.  In  all  the  cases  treated 
below  we  assume  no  =  0. 

Associated  with  the  process  is  a  system  {Q„(x)}  of  polynomials  defined  by  the 
recurrence  formulas 


(13)  S  °’  =  l> 

—  xQn(x)  =  —  (X„  +  Hn)Qn(x)  +  XnQ„+l(^)  +  HnQn-l(x) ,  U  ^  0. 

Clearly  Q„(0)  =  1  for  every  n.  It  is  shown  in  [7]  that  there  is  at  least  one  positive 
regular  measure  on  0  x  <  <»  such  that 

(14)  f  Qi(x)Qj(x)  d$(x)  =  ^  i,j  =  0,  1, 2,  •  •  •, 

Jo 

where 

(15)  xo  =  1,  Try  =  XoXl  ' ' '  X;_1  for  j  ^  1. 

AHM2  •  •  •  m 

The  measure  \f/  is  called  the  spectral  measure  of  the  process.  In  our  present  cases 
the  4*  measure  will  be  uniquely  determined  by  the  parameters  {X„}  and  {nn} . 
This  applies  to  the  bulk  of  birth  and  death  processes  of  physical  and  statistical 
significance.  The  transition  matrix  P(t)  is  represented  by  the  formula 

(16)  PM  =  f0 *  e~xlQi(x)Qj(x)  d\p(x). 

For  a  full  discussion  of  the  properties  of  birth  and  death  processes  we  refer  the 
reader  to  [7],  [8], 

In  section  1  we  establish  the  identifications 


07)  «•>  -/ffX 

The  condition  h(s)  — >  °o  as  s  — >0+  is  satisfied  if  and  only  if  the  process  is  re¬ 
current  or  equivalently  the  series  X)  1  /Xnx„  diverges.  When  this  is  the  case  con¬ 
dition  (4)  is  easily  shown  to  be  satisfied  if  V  is  the  characteristic  function  of  a 
finite  set,  and  other  cases  can  be  analyzed  by  routine  methods.  The  main  part 
of  the  work  lies  therefore  in  showing  that  h(s)  is  of  the  form  (6). 

The  function  h(s)  is  expressed,  rather  indirectly,  in  terms  of  the  parameters 
{X„},  {nn}  by  the  important  formula  ([7],  p.  529) 

f°°  d\p(x)  _  "  _ 1 _ 

0  X  “j-  S  n  =  0  XnXnQn(  s)Qn+l(  s) 


(18) 
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All  quantities  in  the  right  member  of  this  expression  are  determined  directly 
from  the  parameters  by  the  definition  of  7r„  and  by  the  recurrence  formula  (13). 
In  section  3  we  make  a  detailed  analysis  of  this  formula  and  show  that  the 
asymptotic  behavior  of  h(s)  as  s  — >  0+  can  be  deduced,  under  suitable  condi¬ 
tions,  from  the  asymptotic  behavior  of  the  parameters  for  large  n.  In  this  way 
we  find  quite  general  sufficient  conditions  for  h(s )  to  be  of  the  form  (6),  as 
follows. 

Theorem  1.  If  as  n  —>  oc 

(19)  ~  CV-‘,  Tn  ~  Dny~', 

A„ir  n 


where  C,  D,  0,  y  are  'positive  constants,  then  as  s  —  >  0  + 


(20) 

where 

(21) 


h(s)  ~  Hs  ", 


=  0 
0  +  7 


,,  =  (3  +  yr--<  r(«) 

( •••-'!>•  r(l  -  a) 


In  section  2  we  also  prove  the  following.  Note  that  the  assumptions  are  weaker 
than  those  required  by  theorem  1 . 

Theorem  2.  If  as  n  — >  *> 


(22) 


1 


hnTrn 


Ctf-1, 


ir„  ~  Dny  \ 


where  C,  D,  y,  0  +  7  are  positive  constants,  then 

(23)  lim  C.(^) -/(«). 
where 

(24)  1(8)  =  r(l  -  «)  Lo  r!r(r  -  a  +  1)  [(/3  +  y)2] 

and  a  =  0/(0  +  7).  The  convergence  is  uniform  in  every  bounded  region  of  the 
complex  variable  s. 

Theorem  2  is  exploited  in  section  4  to  obtain  limit  laws  for  the  maximum 
random  variables. 

We  conclude  the  general  discussion  by  indicating  the  connection  of  the  asymp¬ 
totic  relationship  (6)  and  the  rate  of  decay  of  the  tails  of  the  first  passage  time 
distributions  of  the  process. 

The  condition  (6)  can  be  translated  into  an  equivalent  condition  on  the  tails 
of  the  first  return  time  distribution  Foo(t)  of  the  zero  state.  The  formula  of  equa¬ 
tion  (1.3)  in  [8]  in  conjunction  with  (16)  yields 

s  /  _  Foo(0]  ^ 


(25) 
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Since  1  —  Fm(t)  is  decreasing,  it  follows  from  Karamata’s  theorem  that 


1  —  Foo(0 


\oL(t)taT(l  -  a) 


as  t  — *  qo 


if  and  only  if,  similar  to  (6), 


0  <  a  <  1,  as  s  — >  0+, 


where  L(u )  is  a  slowly  varying  function,  u  — » « , 
In  a  similar  manner  we  obtain 


1  - 


Xj7rtT(l  -  a)<“L(0 


as  t  — >  oo , 


where  denotes  the  distribution  of  the  first  return  time  to  the  state  i. 

We  note  for  later  reference  that  the  asymptotic  relation  (26)  is  the  necessary 
and  sufficient  condition  that  a  distribution  function  of  a  positive  random  variable 
belongs  to  the  domain  of  attraction  of  a  stable  law  of  index  a,  0  <  a  <  1  (see 
[5]).  In  this  connection  Dynkin  [4]  and  independently  Lamperti  [11]  developed 
the  following  class  of  limit  theorems.  Let 


So  —  0,  Sn  —  +  £‘2  + 


n  Si  1, 


where  are  independent  identically  distributed  positive  random  variables  whose 
distribution  function  is  F(u).  Define  the  integer-valued  random  variables  v(t)  by 

(30)  v{t)  -  n  if  Sn  t  <  Sn+ 1,  t  >  0, 

and  set  7 (/)  =  t  —  $„«)  and  8(t)  =  S^+i  —  i.  They  prove  that  the  limit  laws 


Hm  P  ^  X |  J  ya- 1(]  _  uj-a 

lim  P  ^  x l  =  -----  f  u~a(\  +  u)~l  du, 

t->*>  It  J  ir  Jo 


M  <  x\  _  sh 
.  t  =XJ~ 


0  <  X  <  1, 


0  <  x  <  00  f 


hold  if  and  only  if  F(u )  satisfies  (26).  They  also  show  that  when  E(£)  =  ° °  the 
random  variables  y(t)  and  8(t)  cannot  be  normalized  in  any  fashion  to  produce 
a  nondegenerate  limit  law  other  than  that  of  (31).  (Trivial  modifications  of  the 
normalizing  constants  like  any  function  asymptotic  to  ct  are  considered  not 
different.)  When  E(£)  <  00,  the  distributions  of  y(t)  and  8(t)  converge  without 
renormalization.  This  is  a  familiar  fact  of  renewal  theory  [13]. 

We  shall  apply  the  conclusions  (31)  to  the  random  variable  Y(t)  which  is  the 
time  since  the  last  visit  to  a  fixed  state  (say  0)  of  the  birth  and  death  process.  In 
particular,  under  the  hypothesis  (63)  given  below  we  obtain  (6)  or  equivalently 
(26).  It  is  clear  that  we  are  in  the  situation  of  (29)  where  £,  are  distributed  ac¬ 
cording  to  Foo(t )  and  the  relevant  identification  is  Y(t )  =  7(2). 

Similar  results  can  easily  be  obtained  for  random  walks  by  using  the  substi¬ 
tutions  explained  in  [9],  section  2. 
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2.  Preliminary  formulas 

The  existence  of  a  representation 

(32)  Jq"  e~atP ij(t)  dt  =  w(j)h(s)  +  h(s;  i,j) 

for  the  Laplace  transform  of  the  transition  matrix  of  a  recurrent  birth  and  death 
process,  where  h(s)  — »  -f  oo  and  hi(s;  i,  j)/h(s)  — >  0  as  s  — >  0-f ,  may  be  deduced 
in  two  ways,  which  we  now  sketch.  Observe  that  if  the  process  is  not  recurrent 

then  the  integrals  Jq  Pu(t)  dt  are  finite  and  there  can  be  no  such  representation. 

Our  first  method  appeals  to  the  results  of  section  7  in  [7]  where  it  is  shown 
that 

(33)  <r"Pa(J)  dt  =  +  &(-«)  [of'(-s)  +  Q,(s)  f" 

where  ttj,  Qj(-)  are  the  constants  and  polynomials  defined  above  and  QiJ>(-)  are 
the  polynomials 

(34)  em  =  *  r  qav)  Q4*l  E  !?i(y)  d<Kv)- 

jo  x  y 

Since  the  process  is  recurrent  the  integral  Jq  d\p/x  diverges  [8]  while  on  the 

other  hand  Qj(0)  =  1  solims_>o+  [1  —  Q;(— s)]  J  [1/ (a;  +  $)]  dip  is  finite.  Hence, 
rearranging  (33)  we  have  the  desired  representation  with 

(35)  TT  O')  =  xy,  h(s)  =  j 

Our  second  method  gives  the  result  in  greater  generality.  We  consider  a  re¬ 
current  irreducible  Markov  chain  with  stable  states  and  transition  matrix  Pn(t). 
Let  qo  =  —  Poo(0)  and  ,P,y(0  be  the  probability  the  particle  is  at  j  at  time  t 
having  started  at  i  and  without  ever  returning  to  i  after  leaving  i.  If 

(36)  h(s)  =  JQ  e~stPoo(t )  dt, 

then  h(s )  — >  -foe  as  s  — >  0-f  if  and  only  if  the  process  is  recurrent.  Using  results 
of  Chung  [1],  [2]  and  Abelian  arguments  we  find  a  representation  of  the  desired 

form  with  the  above  h(s)  and  ir(j)  —  oPoflo,  where  iP*j  =  JQ  ,P,y(0  dt.  Special¬ 
izing  this  to  a  recurrent  birth  and  death  process  gives  the  previous  result  again. 
The  details  are  as  follows, 

It  is  proved  in  [1]  that  if  the  process  is  recurrent,  then  0Poj  <  00 .  Observe  that 
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(37)  J  e~stPij(t )  dt  =  s  J  e~tu  ^  j  Pa(t)  dt^j  du 


=  s 


Pjj(t)  dt'jdu  +  s  J 


[“PiAQdi; 

L/ou^(^ 


=  Aj(fi)  +  h(s,i,j). 

Recurrence  of  the  process  implies 


(38) 


for  any  j, 


(see  Chung  [1]  and  [2]).  Here  F*j  is  the  probability  of  reaching  j  from  i  in  finite 
time. 

A  standard  Abelian  argument  leads  to  the  conclusion  lim*-*0  h(s,  i,  j)/Aj(s) 
=  0.  In  fact,  choose  M  so  large  that 


(39) 


f“  P„(i) 


Then  in  view  of  (38),  we  obtain 


(40) 


“m  am  = 


s— » 0 


for  u  >  M. 


and  the  assertion  is  established.  But 


(41)  Aj(s)  =  t Ms)  +  h*(s,j), 

where  and  h(s)  are  defined  in  (35)  and  h*(s,  j)  is  determined  in  the  obvious 
manner,  namely 

(42)  h*(s,j )  =  s  fj  e~su  (fj  [ Pjj(l )  -  Roo(0]  <#)  du. 

It  is  known  that  if  the  process  is  recurrent,  then  oP*j  <  00  and 


['Pj&)  dt 

(43)  lim  *7^ -  =  oPOJqo 

M^“/0  Roo(^)  d£ 

(see  Chung  [1]).  As  previously  it  follows  that  h*(s,j)/h(s )  — »  0  when  $  — >  0+. 
Letting  hi(s,  i,j)  =  h*(s,j )  +  h(s,  i,j ),  the  decomposition  is  exhibited. 

A  recurrent  birth  and  death  process  is  either  ergodic,  in  which  case  ^  has  posi¬ 
tive  mass  p  at  the  origin  [8]  and  h(s)  ~  p/s  or  else  the  process  is  recurrent  null , 
in  which  case  4/  has  no  mass  at  the  origin  and  /i(s)  — >  ° o ,  sh(s)  — >  0  as  s  — *  0+. 
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In  order  for  h(s)  to  be  of  the  form  (6)  with  0  ^  a  <  1  the  process  must  be  re¬ 
current  null,  or  equivalently  [8]  £  7r„  =  +  c0,  H  l/Xn^n  =  +°°. 

The  plan  of  section  2  is  to  assume  1  /X„xn  ~  Cw^-1,  rn  ~  Dny~l,  where 
0  <  £,  y,  and  find  the  asymptotic  behavior  of  h(s)  from  formula  (18). 

In  preparation  for  this  we  express  the  coefficients  of  the  polynomials  Qn(x )  in 
terms  of  the  basic  quantities  irn,  1  /X„t rn.  First  the  recurrence  relation  is  written 
in  the  form 


XTTnQi i(*r)  —  XnXnfQn+l^)  Qn(>r)]  Xn—lTn— l^QnO^)  Qn— i(-T)1) 

(44)  n  ^  1, 

—  xtoQo(x)  =  X07r0[Qi(a:)  -  Q0(x)]. 

A  first  summation,  and  then  another  summation,  produce 


(45) 


X  2^  T^kQk^X}  XjilTn [Qn+1  (^)  Q»(*^)]> 

k  =  0 

Qn(x)  =  1  —  X  £  7~~  Z  TTlQlix), 

k  =  0  Afc7Tfc  2  =  0 


n  ^  0, 
n  2:  1. 


Repeated  differentiation  of  this  identity  using  the  polynomial  character  of 
Qk  leads  to 


(46) 


Q?( 0)  =  _  J_  f 

r!  *=r-i  X^  2=7^1  (r  —  1)! 


We  may  iterate  this  relationship  to  get  the  explicit  expression 
(47)  =  (-!)'  J-  £  J-  ±  ri.. 

T\  k  =  r  —l  AfcTT k  2  =  r  —  1  j  =  r-2  AjTj  t=r-2 


n  >  r  2:  1. 


s  —  1  1  v 

Erl  ttm. 

„=oX,,7r„ 


We  are  now  ready  to  determine  the  asymptotic  behavior  of  (35)  as  s  — *  0-+-. 
It  is  instructive  to  begin  with  the  analysis  of  a  special  case.  We  will  use  first  the 
crude  inequalities 


(48) 
where 

(49) 


1  +  w„s  <;  Q„(— s)  ^  e""s, 


n  —  1  1  k 

=  L: —  L  m  =  — Q»(0). 

*  =  0  AfcXfc  ?  =  0 


s  >  0, 


The  left-hand  inequality  is  immediate  since  all  the  coefficients  of  Q„(—  s)  are 
strictly  positive.  The  right-hand  inequality  is  a  simple  consequence  of  the  fact 
that  Qn(x)  has  only  positive  roots  and  Q„( 0)  =  1.  Indeed, 


(50) 


e.(-s)  =  n(i  +  ^)<exp(s.?A)  = 


It  follows  from  (48)  and  (18)  that 

(51)  £  r~  exp  [  — s(u„  +  un+i)]  ^  h(s )  ^  £  r - -  - — — -  — • 

^oX„7Tn  „  =  0X„7r„[l  +  (a>„  +  wn+i)sj 
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In  some  special  cases  these  crude  bounds  can  be  used  to  secure  the  precise 
asymptotic  growth  of  h(s).  An  example  is  hypothesis  A  below. 

Hypothesis  A.  wn  ~  D,  1/Xnxn  ~  C/n. 

Then  trivially,  co„  ~  CDn  and  co„  +  con+i  ~  2 CDn.  We  define 

(52)  e(x)  =  £  r— 

k  gx  AfeTfc 

It  follows  easily  that  the  asymptotic  growth  of 

”  1 


(53) 

coincides  with  that  of 

(54) 


71  =  0  Xn7Tn[l  +  (^n  +  OJ„+i)s]’ 


1 


/; 


dd(x) 


[1  +  Kxs] 


“f“  KtlS~\ 

Let  Ks  =  1  /X,  then  we  seek  to  determine  the  behavior  of 

dd(x) 


0+, 


K  =  2CD. 


(55) 


/. 


X  +  x 


where  6(x)  ~  C  log  x  as  x  — >  oo .  A  standard  Abelian  argument  applied  to  the 
Stieltjes  transform  shows  that 

<»>  >  /  m 

Hence 


C  log  X 


as 


(57) 


d6(x) 


Cl°gi 


as 


0+ 


J  (1  +Kxs) 

and  the  constant  C  is  that  appearing  in  the  statement  of  hypothesis  A.  The 
details  providing  the  verification  of  (57)  constitute  a  simpler  version  of  the  type 
of  reasoning  embodied  in  the  proof  of  lemma  3  below  and  will  therefore  be 
omitted. 

We  find  the  asymptotic  growth  of  £n«o  (1/Xn7r„)  exp  [— s(a)n  +  wn+i)] 
agrees  with  that  of  the  Laplace  transform  JQ  e~K,xdd(x),  using  a  similar  method. 
An  Abelian  argument  for  the  Laplace  transform  shows  that 


(58) 


/. 


d6(x) 


Clogi 


as 


0+. 


It  is  important  to  notice  that  the  same  constant  C  appears  in  both  (57)  and  (58). 
The  inequalities  (51)  compared  with  (57)  and  (58)  compel  the  limit  relation 

(59)  lim  —  77  —  h(s)  =  C. 


In  summary,  if 

_l _ C 

Xn'JTn  W 


(60) 


JS+log  (1/s) 

and  Tn  ~  D, 


then  h(s)  ~  C  log  -  as  s 
s 


o+. 
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We  consider  next  the  asymptotic  properties  of  h(s )  in  the  case  where 

(61)  ~ —  ~  CnP~l  and  irn  ~  Dny~\  0  <  13,  y, 

An7T  n 

and  try  to  imitate  the  above  technique.  (Note  that  hypothesis  A  is  not  cov¬ 
ered  by  the  present  assumptions.)  An  analysis  of  the  corresponding  Laplace 
and  Stieltjes  transforms  leads  to  the  limit  relations 

lim  spl(p+y)  r^~  exp  [— (co„  +  co„+i)$]  =  Ch 

(£2)  s — >0+  71=0  An^Tn 

lim  £  - 7TTT— r - 71  =  Cj. 

s— >0  +  n  =  0  AnTT 1  -f-  (0Jn  -j-  a>n+i)SJ 

Unfortunately,  we  now  have  0  <  C\  <  C2.  This  means  that  the  bounds 
furnished  indicate  only  the  order  of  magnitude  of  h(s)  for  s  — >  0+,  but  the 
asymptotic  limit  is  not  established.  One  should  mention  at  this  point  that  the 
Darling-Kac  limit  theorems  require  the  existence  of  an  actual  asymptotic  limit 
To  establish  the  existence  of  the  limit  of  sp,{p+y)h(s)  as  s  — >  0+  it  is  necessary  to 
use  considerable  care  and  ingenuity  in  approximating  the  polynomials  Q„(  —  s) 
for  s  near  zero.  This  task  is  carried  out  in  the  next  section. 


3.  The  main  theorems 


Throughout  this  section  we  assume 
(63)  r— —  ~  Cnp~l,  rn  ~  Dny~l, 

AnTT  n 

where  C  and  D  are  fixed  positive  constants.  For  ease  of  exposition  the  prepara¬ 
tions  leading  to  the  main  result  are  presented  in  the  form  of  a  series  of  lemmas, 
some  of  which  may  have  independent  interest.  In  lemmas  1,  2  we  assume 
7  >  0,  /3  -f-  7  >  0,  but  for  lemmas  3,  4,  5,  6  we  assume  j3  >  0,  7  >  0. 

Lemma  1.  For  any  fixed  r  ^  1,  as  n  — >  w 


(CD)rnr(p+y) _ 

7  + ■  (k  —  l)j8)l  (/3  +  7)rr! 


=  ernr{p+y), 


where  er  is  defined  in  the  obvious  manner. 

Proof.  The  proof  is  by  induction  on  r  based  on  formula  (46)  and  the  trivial 
asymptotic  relations  ka~x  ~  n°/a  with  a  >  0.  We  indicate  the  proof  in  the 
case  r  —  1.  For  any  e  >  0  let  M{t)  be  determined  so  that  for  all  n  ^  M(i) 

(65)  (1  -  t)Cn&~1  ^  r~ —  £  (1  +  e)CnP-1 

A  n^T  n 

and  (1  —  c)Dny~x  ^  71- „  ^  (1  +  e)Dny~x. 
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n— 11  k  n  — 11  k 

£  rr  £  *■,  =  £  £*«  + 

i  =  0AifJti  =  0  k  =  M  AfcTTfc  2=  M 


°CC^> 


Using  the  above  estimates  we  obtain 

(67)  (1  -  *yCD  n£  ¥~l  E  Ir-1  g  |Qi«(0)| 

fc  =  jw  z=at 

g  (1  +  e)2CD  ”e  E  Z7"1  +  0(w*), 

k=  M  l  =  M 

and  from  this  the  assertion  for  r  =  1  follows.  The  cases  r  ^  2  are  done  similarly. 

We  next  obtain  a  bound  on  the  coefficients  of  Qn(x )  which  is  weaker  than  (64) 
but  valid  uniformly  in  n  and  r. 

Lemma  2.  For  all  n  and  1  ^  r  ^  n 

om  m  (n +  !)'<*-* 

’  rl  =  7'/?  (r!)2 

where  M  is  an  appropriate  fixed  constant  independent  of  n  and  r. 

Proof.  In  view  of  (63)  we  may  choose  M  sufficiently  large  so  that 

(69)  ——  ^  Min  +  l)*3-1  and  7r„  ^  M{n  +  l)7-1,  n  ^  0. 


It  follows  by  comparison  with  an  integral  of  the  form  f  ”  xa  dx  for  an  appropriate 
a  that 

n-l  1  JVf  n-1  ]U 

(70)  £  5-7  ^  f  (n  +  1/  and  E  ir*  ^  f  (n  +  l)7. 

fc  =  0Afc1Tfc  P  k  =  0  7 

Thus 

n— 1  1  A:  /n— 1  1  \  /n— 1  \  A,f2 

(71)  |Qiu(0)|  =Er7lx,S  Eri-  s|(»+  1)2«, 

A;  =  0  A*7Tk  Z  =  o  \k=0Afe7rjfe/  \z  =  0  /  P7 

which  is  the  result  for  r  =  1.  Using  induction  on  r,  we  get  from  (46) 

m)  Q m  <T1J-y 

(72)  r!  (r- 1)1 

T[/f2r  n—1  n— 1 

<  M*r  (n  +  1  )r(p+7) 

“  7r/r  (r!)2 

which  completes  the  proof. 

For  each  fixed  positive  integer  v  let 


=  E  «r«r, 

r  =  0 


e0  1>  &r  — 


where 


rl(0  +  7) 


2r  ^  n  (fc  -  a)  j 


0  +  7 
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Lemma  3.  (/3  >  0,  y  >  0).  For  each  fixed  v  and  constant  B  >  0 


x  i 

(75)  lim  £  r - pr — 7-  ■■■■■■ 

*-♦0+  n  =  oXn?Tn[/(»)(-B^+'rs)]2 


=  B-“ 


c 


I. 


00 


0  +  7  / 0  !7(»-)(0]2 

Proof.  The  series  in  (75)  can  be  expressed  in  integral  form  as 

1 


(76) 
where 

(77) 


/; 


[/,(a^£s)]2 


d<p(x), 


<p(z)  =  E  ~ 

k  gx  Afc7Tfc  p 


as  x 


Let  y  =  £0+7  and  (p(y)  =  <p(?/1/(/3+7))  and  set  Bs  =  u.  The  integral  (76)  becomes 


(78) 


/: 


d<p(y) 

[I(v)(yu)Y 


The  asymptotic  growth  of  <p(x)  implies  <p(y)  ~  (C/fi)ya  as  2/  — >  co .  Integrating  by 
parts  for  u  >  0  gives 


f(u)  = 


d^M. 


(79)  ,  [/w(yu)],  Xo 

A  direct  calculation  yields 


=  b  +  u 


/: 


y(2/)2f/^(yM)1  dy 
[I{r)(yu)]3 


(80)  u°f(u)  -  H(y)  =  ~  +  m“+1 

Ao 


/: 


?(y)  -  ^  2/“  j 


2I'w(yu)  dy 


[L(yu)]3 


where 


(81)  H(v)=-p2 


C0  fx  t«!U(t)  dt  _  Ca 


I. 


_  Cot 

[/«(*) ]»  is  J0 


t«- 1 


[/(o(012 


d/  = 


C 


£  +  7 


r  »  £a— 1 

Jo  f7(*-)( 


-1  d* 

[I(o(012 


Splitting  the  integral  on  the  right  in  (80)  into  two  parts,  one  extended  over  the 
segment  [0,  T]  and  the  other  over  the  segment  (T,  <x>),  we  easily  deduce 


(82) 


lim  \uaf(u)  —  H(v) |  ^  iT’(x')  sup 
u— >0  4-  (sr 


§  <r°m  -  1 


Since  T  can  be  made  arbitrarily  large  the  lemma  follows. 
Lemma  4.  (0  >  0,  7  >  0). 


(83) 


lim  s°7i(s)  ^ 


(7 


/3  +  7 


f°°  ta~l  dt 

Jo  [/«(0T 


=  ffW, 


0 


18  +  7 


Proof.  Choose  B  <  1  arbitrary  and  fixed.  By  virtue  of  lemma  1  there  exists 
A(B)  so  that  for  all  n  ^  N 

>(:ii(o)l  Mr)t 


(84) 


min  ^1Q"^Q)1,  ^  Bernr(y+V  ^  Brern^\ 


r  =  1,  *  *  *,  v. 
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It  follows  by  the  definition  of  /<„)  that  min  [Qn+i(  —  s),  Qn(— s)]  ^  Iiv)(BnP+ys) 
for  all  n  ^  N  and  s  >  0.  Consider  now 


(85)  s“^(s)  =  s“  £ 


N 

=  S“  I 


n  =  0^n^nQn(  s)Qn+l(  s) 
1 


n  =  0  ^n^nQn(  s)Qn+l(  $) 


+  s“ 


1 


E 


+  s“  £ 


=  iV”-hl  ^n^nQn(  s)Qn+l(  $) 

l 


„=oX„7T„Qn(-s)Qn+1(-s)  n=ni  X„i„[/(f)(Bn^s)]2 

=  «•*. ■»(«)  +  8*  to 


where 
(86) 

Invoking  lemma  3,  we  obtain 


v  i  ^1 

v(s)  =  „?0X^e»(-s)Q,-H(-s)  “  »?oX.T,[/w(Bn^«)]*' 


(87) 


lim  s“h(s )  ^  Z?~“  — — — 
s^o+  |8  +  7 


Jo  Ui^t)]2 


Since  B  is  arbitrarily  less  than  1  we  now  let  B  approach  1  and  (83)  is  established. 

The  sequence  of  constants  H(v )  is  decreasing  and  in  the  limit  as  v  — >  °o  we 
have 


(88) 

where 

(89) 


_  r  °°  /«  i 

lim  *■*(«)  ^  -r±~  / 

*-o+  0  +  7  Jo  U(012 


/(0  =  £  ertr, 


Co  =  1  and  er  = 


=  H(  oo), 

i £211 


r  =  0 


r!(^  +  7)2r  ' 

11  (fc  -  «) 

A*  1 


In  order  to  verify  the  reverse  inequality  to  that  of  (88)  we  introduce  the 
functions 


(90)  «/(,)(0  —  £  erir  +  £  /r^r, 

r  =  0  r  =  y+ 1 

where  er  is  the  same  as  before,  fr  =  (M2r/ 7r/?r)  [1  /(r  !)2]  and  M  is  defined  ac¬ 
cording  to  (68). 

A  trivial  inequality  on  eT  gives 


We  could  have  determined  the  constant  M  appearing  in  the  upper  bound 
arbitrarily  so  long  as  it  is  sufficiently  big  and  (68)  persists.  Suppose  hereafter  that 
M  is  chosen  satisfying 
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(92) 


cm 


0  +  7 

Then  it  follows  on  comparison  with  (89)  that 
(93)  eT  ^  fr. 

Lemma  5.  (0  >  0,  7  >  0) .  For  each  fixed  v  and  B  >  0 

1  B~*C  C*  ta~x  dt 


(94) 


lim  s“  £ 


/: 


(95) 


0+  n -O^nTTn {«/(*) [(^  +  2Y+yBs]} 2  0  +  7  /o  [«7(«-)(0]2 

The  proof  is  similar  to  that  of  lemma  3  and  will  be  omitted. 
Lemma  6.  (0  >  0,  7  >  0). 

C  C*  ta~x  dt 


B/kis>  =  fi  +  yh 


Proof.  Choose  B  >  1  arbitrary  and  fixed  and  let  »»  be  a  fixed  integer.  By 
lemma  2  there  exists  N  —  N(B)  so  that  for  all  n  ^  N 

.(0)1  10£M 

r! 

v. 


(96) 


max 


/IQfti( 

\  r\ 


^  ^  Ber(n  +  2)r(P+y)  ^  BreT(n  +  2)r('3++ 

r»l,2,  • 


(97) 


On  account  of  lemma  2 

\QIM 


^  fr(n  +  1)'(^>  ^  frin  +  2)r((3+7) 


for  all  0  S  t  n.  It  follows  from  (96)  and  (97)  that  for  n  N, 

(98) 

max  [Qn+i(-«),  Qn(s)]  ^  £  B'er(n  +  2)'(0+7V  +  £  B'fr(n  +  2)'<*W 

r  =  0  r=>v  +  l 

=  /w(fl(»  +  2)*+»«). 

The  remainder  of  the  proof  is  an  adaptation  of  the  reasoning  in  lemma  4  and 
we  shall  be  brief.  We  have 


(99)  «“*(»)  -  s°n?0X.T„On(-s)e.+1(-S) 

Ar  1  00  1 

-  *“  »?oX.t.Q.(-s)C.+i(-«)  +  S‘\-¥+i  X.T.[yw(B(n  +  2)*+>s)]! 

=  +  2) «+’■>*)]*  +  S°ij'(s)' 


It  follows  by  lemma  5  that 

B~aC  f 00  £a— 1  d£ 

(100)  S:^(s)  S  j0 

Since  B  >  1  is  arbitrary  we  may  let  B  — »  1  and  the  desired  result  follows. 
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As  v —>  oo,  Jy(t)  ^  Jy+i(t)  which  decreases  monotonically  point  wise  to  the 
function  I(t).  Allowing  v  — »  »  in  (100)  shows  that 


(101) 


Jim _sah(s)  ^ 

s— >0  + 


C  f  ta~l  dt 

P  +  7  J0  [/(OP' 


The  function  I(t)  in  (89)  can  be  expressed  in  terms  of  the  modified  Bessel 
function  I-a(x)  where  a  =  (3/(p  +  7);  in  fact 


(102) 


m  =  r(i  - 


r  cm  1 

/2  VCDt\ 

Los  +  7)!J 

M/s+ J 

The  constant  i/(«o )  in  (88)  can  be  expressed  in  terms  of  the  integral 


(103) 


1  ds 
I2-a(s)  S’ 


which  can  be  evaluated  if  we  observe  that  I-a(x )  J*  [1  //_«(s)2s]  ds  is  a  second 
solution  of  the  modified  Bessel  equation  (0  <  a  <  1).  The  final  result  is 


(104) 


H(o 0)  =  &±vl 
v  )  ra-i  r 


JM. 


C “-'D*  r(l  -  a) 


Combining  (104),  (101),  and  (88)  gives  theorem  1. 

We  are  also  within  easy  reach  of  theorem  2.  If  s  ^  0,  B  >  1,  then  for  every 
integer  v  inequality  (98)  gives 

(105)  hmsu] p  Qn  £  J w ( Bs ) . 

Letting  B  —>  1  and  afterwards  v  —*  <»  ,  we  have 
(1°6)  lim  sup  Qn  [(n  “2)^]  = 

for  s  ^  0.  On  the  other  hand  if  s  ^  0,  B  <  1 ,  then  for  every  integer  v  inequality 
(84)  gives 

(1°7)  lim  inf  Q„  [(B 


Letting  J3  — >  1  and  afterwards  we  have 

(108)  lim  inf  <3„  [(„  " 2)#+J  §  /(«)• 

Hence  Qn[— s/(n  +  2 y+y]  — >  I(s )  for  s  ^  0.  Now  if  s  ^  0  and  e  >  0  we  have, 
if  n  is  large  enough, 

(109)  Qn  [(n  +  2 y+yl  ~  Qn  U]  “  Qn  [(n  +  2)^] 

and  hence  Qn(  —  s/rtP+y)  — >  I(s)  for  s  ^  0.  In  any  circle  |sj  ^  R  of  the  complex 
plane  the  polynomial  Qn{—s/n&+y)  has  its  maximum  modulus  at  s  =  R  and  so 
by  the  Vitali  theorem  the  convergence  is  uniform  as  asserted  in  theorem  2. 
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We  close  this  section  by  describing  two  examples  where  theorems  1  and  2  are 
applicable. 

Example  1.  Linear  growth.  Let 


(HO) 


X„  =  n  +  a,  n  ^  0, 

M»  =  n  +  b,  n  ^  1,  mo  =  0. 


This  describes  a  model  of  biological  growth  where  the  birth  and  death  rates 
are  proportional  to  population  size  and  immigration  and  emigration  may  occur. 
A  direct  calculation  yields 


(HI) 


r(n  +  a)  r(6  +  1 ) 
r(n  +  1  +  b)  r(a) 


We  restrict  ourselves  first  to  the  case  where  a  >  b  which  ensures  that  the  process 
is  either  null  recurrent  or  transient.  It  follows  that 


w 


(112) 


Xn  TTn 


.  r(6  +  l) 
r(«) 

r(q) 


r(i>  + 1) 


In  the  case  b  +  1  >  a  >  b,  the  process  is  null  recurrent  and  theorem  1  is  in 
force.  Comparing  (112)  with  (63)  leads  to  the  identifications  0  =  b  +  1  —  a, 
7  =  a  —  b  and  therefore  a  =  b  +  1  —  a.  It  follows  by  theorem  1  and  (7)  that 
the  fraction  of  time  in  [0,  $]  that  the  population  size  is  zero  is  of  order  tb+1~a  as 
t  — *  oo .  An  extreme  case  of  this  example  b  =  0,  a  —  1  fits  the  assumption  of  (60) . 
In  this  situation 


(113) 


7T„  ~  D, 


_L _ C 

hjiTTfi  n 


where  C  and  D  are  suitable  constants.  The  normalization  constant  for  occupa¬ 
tion  time  random  variable  is  now  C  log  t  rather  than  a  power  of  t. 

Example  2.  Queueing.  Let 

(114)  X„  =  X,  n  ^  0,  Hn  =  X,  n  ^  1,  Mo  =  0. 

This  corresponds  to  a  simple  queueing  phenomenon  involving  exponential  inter - 
arrival  and  exponential  service  times.  The  case  of  main  interest  in  this  paper  is 
concerned  with  the  critical  case  where  the  rate  of  arrival  equals  the  rate  of 
service.  Trivially,  we  have 


(115) 


7 r„  ~  1, 


1  1 

-  — ■ 

XnTTn  X 


Comparison  with  (63)  shows  that  0  =  7  =  1  and  consequently  a  =  1/2.  On  the 
basis  of  theorem  1  and  (7)  we  conclude  that  the  fraction  of  time  the  server  is 
free  (the  process  is  in  state  0)  during  the  time  interval  [0,  t]  is  of  order  V t  as 
t  — >  oo . 
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4.  Extensions 


A  function  L{t)  with  0  ^  t  <  co }  is  called  slowly  varying  as  i  — ■»  »  if  it  is 
continuous  and 

(116)  lim  ^7^  =  1  for  X  >  0. 

It  has  been  shown  by  Karamata  [6]  that  L  is  slowly  varying  if  and  only  if  it  has 
a  representation 

(117)  IAS)-  f(l)  exp  j  fx*}’ 

where  <p  and  e  are  continuous  functions  such  that  <p(t)  — ■>  c  >  0,  e(J)  — *  0  as 
t  — >  oo.  From  this  it  may  be  deduced  that  the  limit  in  (116)  is  uniform  in  any 
interval  0<X0^X^Xi<°°.  This  fact  is  helpful  in  deducing  the  asymptotic 
relation 

(118)  £  ka~lL(k)  ~  VlMA,  a  >  0. 

k= i  a 

The  proof  of  (118)  proceeds  as  follows.  We  decompose  the  sum  into  two  seg¬ 
ments  [1,  [eft]  —  1),  ([eft],  ft)  where  e  >  0  is  chosen  fixed  but  may  be  arbitrarily 
small  ([eft.]  designates  the  largest  integer  preceding  eft).  Clearly 

[«n]  Mna 

(119)  £  k«~'L{k)  —  L(n), 

l  a 

where  C  is  an  appropriate  constant.  For  sufficiently  large  ft,  1  —  <5  si  L(k)/L(n) 
^  1  +  8  if  [eft]  ^  k  si  ft,  where  8  is  a  small  positive  number.  It  follows  that 

(120)  (1  -  8  -  e“)L(ft)  —  ^  £  kr~'L{k)  <>  (1  +  8)  L(n)(n  +  1)!. 

a  [<n]  a 

Dividing  by  L(ri)na/a  we  obtain 


(121) 


1  —  8  —  2e“  <  lim  a  — 


£  kr~lL(k) 


naL(ri) 

g  e“  +  1  -f  8. 


<  lim  a 


£  k*~lL(k) 

ft“L(ft) 


But  e  >  0  and  8  >  0  are  arbitrary  and  therefore  (118)  obtains. 
From  (118)  we  have,  since  a  >  0, 


(122) 


L 

^  =  0 


ka~lL(k)  ^  M 


(ft  +  l)°L(ft) 
a 


where  M  is  a  constant  not  depending  on  ft. 

The  results  of  the  previous  section  may  be  extended  to  deal  with  the  more 
general  asymptotic  laws 


XnTT  n 


7 r„ 


(123) 


Cnp~lL(n), 


Dn‘t~lK{n), 
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where  C,  D,  y,  P  +  7  are  positive  constants  and  L(t),  K(t)  are  slowly  varying  as 
t  —*  oo .  By  imitating  the  analysis  of  lemmas  1  and  2  we  obtain 

(124)  —  erL(n)K(n)n'W+y\ 
r  fixed,  with  er  as  in  (89)  and 

(125)  ^  frL(n)K(n)n'V+y\ 

all  w,  1  r  ^  n,  with/r  as  in  (90).  Continuing  to  imitate  the  previous  analysis 
we  arrive  at  the  following  result. 

Theorem  3.  If  (123)  holds  with  K(n )  =  1  /L(n),  p  >  0,  y  >  0,  then  as  s  — >  0+ 

( 126)  h(s)  ~  H(o o  )s~aL(s~llp+y) , 

where  a  =  p/{tp  +  y)  and  H(o o)  is  given  by  (104). 

In  the  proof  one  encounters  the  integral 


™  L'?S ?«»■">« 


H 


m 

m 


ta 


[©' 


1/^+7 1  l\UJ 


1/0+7  " 

dt. 


Using  the  properties  of  slowly  varying  functions  it  follows  by  dominated  con¬ 
vergence  that  as  u  — >  0  d-  this  is  asymptotic  to 


(128) 


L 


i\t) 1 


In  a  simpler  fashion  we  also  obtain 

Theorem  4.  If  (123)  holds  with  y  >  0,  P  +  y  >  0,  then 


(129) 


ll™Qn  _np+yL(n)K(n) _  7(s)’ 


where  I  (s)  is  given  by  (102)  and  the  convergence  is  uniform  in  every  bounded  region 
of  the  complex  variable  s. 

The  detailed  proofs  of  theorems  3  and  4  are  omitted. 

Examples.  Consider  the  generalized  linear  growth  model  with 


(130) 


Xn  —  n  -j-  a  -f-  o(l),  n  Si  0, 

=  n  +  b  -f  o(l),  n  ^  1,  mo  =  0, 


where  6  +  1  >  a  >  6,  a>0.  We  then  have 


(131) 

log  7T n  =  -log  n  +  log  Xo  +  log  £l  +  |  +  log  £l  +  |  +  pp 


=  (a  —  6  —  1)  log  n  4-  7n  +  I  T> 

&  =  i  ^ 
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where  yn  has  a  finite  limit  as  n  — »  »  and  e*  =  (A*  —  a)  —  ( ju&  —  6).  Hence, 
taking  exponentials,  ir„  =  na~h~lL(ri),  where 

(132)  L{n)  =  eyn  exp  X)  —• 

k—1 

If  €fc/fe  converges  we  have  the  case  of  the  previous  section  but  if  this  series 
diverges  then  L(n)  can  be  extended  to  a  slowly  varying  function  L(t)  which  may 
— *•  0  or  +00  as  n  — >  00 .  Thus 

(133)  x„  ~  na-b-1L(n),  r-^—  ~  n^Kiri), 

Xn7Tn 

where  L(t )  and  K(t)  =  1  /L(t)  are  slowly  varying. 

Finally  we  discuss  a  set  of  asymptotic  growth  laws  of  exponential  character 
for  which  an  analogue  of  theorem  4  holds.  This  result  is  typical  of  a  large  class 
of  limit  theorems  and  we  do  not  attempt  to  exhaust  all  the  possibilities.  The 
method  is  that  of  theorem  4  and  is  quite  general.  It  is  emphasized  that  theorem 
3  is  not  correct  under  the  conditions  of  theorem  5. 

Theorem  5. 

(i)  Let 

(134)  Tn  =  CpnnPL(ri) ,  - —  =  Z)  *  rr^  n  ^  1, 

A„t„  pn  Lin) 

where  p  >  1,  L{n)  is  slowly  varying  as  n—>  00  and  is  real.  Then 


(135) 


Q 


"(cD  log  n) 


exp  [ ps/(p  -  1)], 


<CD  log  n, 

and  the  convergence  is  uniform  in  every  hounded  region  of  the  complex  plane. 
(ii)  Let 


(136) 


7rn  ~  CpnriPL(ri), 


1 


D 


7-/3— * 


X„7Tn  ~  L{n)pn 
where  p  >  1 ,  L(n)  is  slowly  varying  0  <  8  <  1  and  (3  is  real.  Then 

(137) 

uniformly  on  every  bounded  region  of  the  complex  plane. 

To  illustrate  this  theorem  consider  a  linear  growth  process  with 


/  -s  \ 

ps 

\CDnl~sJ 

^eXPL(f  -  1)(1  —  5)  J 

(138)  X„  =  Aw  +  a,  p.n  =  pn  -f  b, 
where  X  >  p,  a  and  b  are  real.  A  simple  calculation  gives 

(139)  tt„  ~  Cpnn*-h~\  ~ ~  ~  n*~\ 

An^Tn  P 

where 


(140) 
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6.  The  maximum  random  variables 
We  shall  develop  a  limit  law  for  the  random  variables 

(141)  M(t)  =  max  X(u), 

where  X(t)  is  the  birth  and  death  process  with  X(0)  =  0,  whose  infinitesimal 
parameters  obey  the  asymptotic  growth  law  (63)  or  more  generally  (123).  We 
will  treat  only  the  case  (63).  In  analyzing  (141)  we  use  a  familiar  duality  princi¬ 
ple.  Let  the  random  variable  Tij  be  the  first  passage  time  for  a  particle  starting 
in  state  i  to  reach  state  j.  Since  the  path  functions  are  continuous  [10]  (transi¬ 
tions  occur  only  to  neighboring  states)  we  see  that 

(142)  Tij  —  Ti,i+i  -j-  7\+i,i+2  +  •  •  •  +  Tj-ij,  j  >  i. 

The  Laplace  transform  of  the  distribution  of  Titj  is  [10] 

(143)  s  >  0. 
The  Laplace  transform  of  the  distribution  of  Tiin/np+y  is  then 

(144) 

Appealing  to  theorem  2,  we  deduce  that  the  distribution  function  Fn(s)  of 
the  random  variables  Tiin/np+y  converges  to  a  distribution  function  F(x)  of  a 
random  variable  whose  Laplace  transform  is  <p(s )  =  l//(s),  where  J(s)  is  given 
in  (89).  We  also  note  that  F(x)  is  independent  of  the  initial  state  i.  From  the 
explicit  expression  for  £(F)  it  follows  easily  that  F(x)  is  absolutely  continuous, 
and  hence  Fn(x )  —*  F(x)  uniformly  on  0  ^  x  <  » .  We  convert  the  limit  state¬ 
ment  regarding  the  variables  T0,n  into  one  involving  M(t)  with  the  aid  of  the 
relation 

(145)  P{T0,n  g  u}  =  P{M(u )  ^  n}. 

From  (145)  follows  Fn(u)  =  P  {M  (n|3+7w)  ^  n}.  Let  t  =  n^+yu,  n  =  (t/u)ll{p+y). 
Then  we  have 

(146) 

or  equivalently 

(147)  limPp^S*}-!-^). 

Although  this  limit  law  is  “explicitly  known”  in  the  sense  that  £(F)  =  l//(s), 
it  is  complex  and  unwieldy.  We  next  show  how  to  compute  the  asymptotic 
moments  of  M(t),  illustrating  the  method  for  the  first  moment. 
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Let 

(148)  U(t)  =  t  P{Ta, n  S  (}. 

n  =  1 

Since  the  right  member  of 

(149)  ±  f"e—P{T0,n  £t}dt  =  \±  rrj— 

n  =  1  Jq  S  n  =  l  vln\  S) 

converges  for  every  s  >  0,  we  see  that  U(t)  <  co  for  almost  all  t.  But  U(t)  is, 
like  each  term  in  (148),  a  nondecreasing  function  of  t.  Hence  (148)  converges 
for  all  t  ^  0.  Now  for  fixed  t  each  term  of  (148)  is  a  nonnegative  decreasing 
function  of  n,  so  by  partial  summation 

(150)  U(t)  =  £  n[P{To.n  £  t}  -  P{T0,tl+1  ^  0] 

n  =  1 


=  E  nP{M(t)  =  n)  =  E[M{t)l 


n  —  0 

Now  following  the  method  of  section  2  we  get 

«  1  1 

(151)  ~ 

and  hence 

(152) 


n  =  l  Qn(  —  S)  03  +  7)sl/(*+Y) 

Kg 


1. 


e~atE(M(t))  dt 


•  tuw+y)  dt 

m  t 

s-l-\ IW+y) 


0, 


o  0  +  y 

where  K0  is  the  integral  in  (151).  Since  E[M(t)]  is  positive  and  increasing  we 
may  use  Karamata’s  theorem  to  get  from  (152) 

Ko 


(153) 


E[M(t)] 


»+T)r(1+f+;) 


£1/ (fl+y) 


t  — >  oo  , 


Calculation  of  higher  asymptotic  moments  leads  to  similar  but  more  tedious 
calculations. 

We  close  this  section  with 

Example  1.  Let  X„  =  a  with  n  ^  0,  and  let  n„  =  a,  with  n  ^  1,  and  mo  =  0. 
We  found  earlier  (the  end  of  section  3)  that  in  this  case  0  =  7  =  1.  Then 

(154)  lim  £  (^t)  =  — ~ 1  /— ■ 

\n2  )  cosh  Vt/a 

The  inversion  of  (cosh  V t/a)~l  gives  a  theta  function  distribution  F(x)  whose 
density  is 

1 


(155)  f(x)  = 


/—  E  (~l)n(2 n  +  1)  exp  [— (2n  +  l)2/4 ax] 
Vclt  xw  »-o 


for  x  ^  0 
for  x  <  0. 
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The  density  function  g(x )  of  the  limit  distribution  of  M (t)/V t  is 

(156)  = 

6.  Other  applications:  sojourn  time  in  a  half  interval 

We  pointed  out  in  the  introduction  that  knowing  that  h(s )  possesses  the  form 
(6)  leads  to  numerous  consequences  and  insights  pertaining  to  the  nature  of 
various  distributions  of  functionals  on  the  process.  In  particular,  under  the  con¬ 
ditions  (63)  of  section  3  we  may  apply  the  Dynkin-Lamperti  theorem  referred 
to  in  (31).  For  example,  if  we  consider  the  queueing  model  of  section  3  we  con¬ 
clude  that  the  time  since  the  server  was  last  free  grows  like  t  and  the  finer 
knowledge  of  this  distribution  is  expressed  in  (31). 

Another  direction  of  applications  of  (6)  has  to  do  with  the  occupation  time 
of  an  infinite  set  of  states.  Consider  a  birth  and  death  process  whose  state  space 
is  now  the  full  set  of  integers,  —  <»  <  n  <  « .  Let  Xn,  nn  and  X»,  n'n  denote  the 
birth  and  death  rates  for  n  ^  0  and  n  <  0  respectively.  We  assume  these  are 
all  positive. 

Let  the  random  variable  %(t)  be  the  time  during  the  interval  (0,  t )  for  which 
X(t)  ^  0.  In  other  words,  £(/)  is  the  occupation  time  for  the  set  of  nonnegative 
states  during  (0,  t).  Similarly,  let  rj(t)  denote  the  occupation  time  during  the 
interval  [0,  t )  for  which  X(t)  <  0.  Obviously  £(<)  +  rj(t)  =  t.  We  assume  that 


(157) 

^  C#-1, 

An’TTn 

rj1! - CV-\ 

A  _  »7T  _  n 

Trn  Dn7-1, 

n  2:  0, 

n  >  0, 

where  ir0 

=  1  and 

(158) 

X0X1  •  •  •  Xn_i 

11  1 

M1M2  •••/*» 

TTn  —  7 

MlM2  *  *  ’  Mn 

7r— n  \l\f  \l 

A2A3  •  •  •  A„  +  i 

We  could  deal  equally  well  with  more  general  rates  of  growth  of  type  (123) 
at  the  expense  of  greater  technical  complication  with  no  essential  new  ideas. 

It  will  be  convenient  to  consider  an  alternative  formulation.  Let  U(t)  repre¬ 
sent  a  stochastic  process  with  two  possible  states  A  and  B.  For  definiteness,  let 
U(  0)  =  A. 

Denote  by  &,  rji,  &>,  *  *  *  the  successive  sojourn  times  that  XJ{t)  spends  in 

states  A  and  B  respectively.  We  suppose  {£,}  and  {17*}  are  independent  identi¬ 
cally  distributed  positive  random  variables.  Now  let  \{t)  and  r)(t)  denote  the 
total  sojourn  times  spent  in  A  and  B  respectively  during  the  time  interval  (0,  t). 
Takacs  in  [14]  develops  several  limit  laws  for  %(t)  and  rj(t)  under  the  conditions 
that  {£,•}  and  {rjy}  belong  to  a  domain  of  attraction  of  respective  stable  laws. 

We  now  show  that  the  random  variables  i-(t)  and  rj(t)  can  be  identified  with  a 
family  of  random  variables  £(£)  and  77  (0  arising  in  the  manner  of  the  pre- 
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ceding  paragraph.  In  fact,  let  {£,}  denote  independent  observations  on  the  first 
passage  time  from  state  0  to  —1,  and  similarly  let  {m}  denote  independent 
observations  of  the  first  passage  time  from  state  —1  to  0.  As  the  process  U(t) 
unfolds,  we  observe  a  sojourn  time  spent  on  the  nonnegative  axis  of  length  £i, 
then  a  time  171  spent  on  the  negative  axis,  etc.  We  associate  with  the  process,  at 
hand,  a  new  stochastic  process  U(t)  of  two  states  A  and  B  by  the  definition 
U(t)  =  A  if  and  only  if  X(t)  ^  0,  U(t)  =  B  if  and  only  if  X(t)  <  0.  It  is  mani¬ 
festly  evident  that  f(£)  =  £(0  and  ij(t)  =  ri(t)  as  claimed. 

Let  Fo,-i(x)  denote  the  first  passage  distribution  from  state  0  to  state  —1.  It 
follows  easily  from  (18)  that 

(159)  s  J  e~sx[l  —  F0,-i(x )]  dx  =  ■— y  +  ch 

where  h(s )  has  the  properties  of  (6).  This  implies  as  noted  in  connection  with 
(26)  by  virtue  of  the  Karamata-Tauberian  theorem  that  £»  belongs  to  the  domain 
of  attraction  of  a  stable  law  of  index  a  =  /3/(/3  +  7).  Similarly,  we  deduce  that 
F_  1,0(2),  the  first  passage  distribution  from  state  —  1,  to  state  0,  belongs  to  the 
domain  of  attraction  of  a  stable  law  of  index  a  =  0708'  +  V). 

We  now  have  all  the  ingredients  with  which  to  apply  the  results  of  Takacs. 
These  yield  various  limit  laws  for  £(()  and  rj(t).  Specifically,  under  the  assump¬ 
tions  (157)  and  suppose  for  simplicity  a  =  a',  then 

(160)  lim  P  gx\  =  H(x) 

<->«  [_  t  j 

and  H(x)  is  the  distribution  function  of  a  random  variable  f  —  B2d/  (A2£  +  B2d), 
where  6  and  9c  are  independent  random  variables  each  of  whose  distribution 
functions  is  a  stable  law  of  index  a,  and  A2,  B2  are  appropriate  positive  con¬ 
stants  determined  from  F_ i,o(x)  and  F0,-i(x). 
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